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Background & Literature 


• Plethora of research examining factors 
contributing to students’ decision to enroll in 
college, their persistence, and graduation 

• This research models the work of Johnson (2008) 

• Taking both student- and school-level characteristics 

• And follows the approach of Adelman (2006) 

• focuses on the student’s pathway through high school 
to enrollment, persistence, and ultimately graduation 
with a Bachelor’s degree. 
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Data 


• Student high school performance and higher 
education enrollment data were acquired from the 
Department of Education (DOE) from a large, 
diverse state located in the continental United 
States 

• National assessment data were acquired from 
College Board’s archives 
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Methods: 

Hierarchical Generalized Linear Models (HGLMs) 

• Hierarchical linear modeling is appropriate here 
because students are nested in high schools 

• Two-level HGLMs predicting the three outcomes 
(enrollment, persistence, graduation) using a 
Bernoulli distribution 

• HGLMs estimated through restricted penalized 
quasi-likelihood (PQL) estimation method 

• Tests if student and school level variables can 
predict the outcomes 
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Methods: Variables 


Student level variables 

• Gender 

• Limited English Proficiency status 

• AP course taker flag 

• Race (dummy coded into four variables) 

• Free/reduced lunch status 

• High school GPA 

• SAT taker flag (enrollment only) or SAT 
Verbal & Math scores (persistence and 
graduation) 

• 1 0 th grade state assessment scores in 
Reading and Mathematics 

• Percent of high school coursework at 
an honors, pre-International 
Baccalaureate (IB), IB, or AP level 
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School level variables 

• Percent absent 21 days or more 

• Percent free/reduced lunch status 

• Mean ACT composite score 

• Percent who took the ACT 

• Mean SAT (Verbal + Math) score 

• Percent who took the SAT 

• Percent who took the PSAT 

• Percent of teachers with a Master’s degree 
higher 

• Teachers’ average years of experience 

• Total number of discipline referrals in 2001- 
2002 academic year 

• Percent of class that are gifted 

• Percent of class identified as ELL 

• Number of AP courses taught at the school 

• Student-teacher ratio r CollegeBoard 

' inspiring minds' 

• Number of Full-Time teachers 


Sample 



Table 1: Basic Demographic Information 

Percentage of Sample 


Gender 


Male 

46.5% 

Female 

52.8% 

Race.Ethnicitv 

ms 


Asian 

2.4% 

Black 

19.1% 

Hispanic 

15.7% 

White 

58.3% 

Other 

4.5% 

Limited English Proficient 

13.1% 

Free Reduced Lunch 

3^.5% 

AP course takers 

2 7 .3% 

\ CollegeBoaxd 
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Sample 


Table 2: Percentage of Sample Enrolled, Persisted, and Graduated from a Public Instate 
l Institution 


Outcome 

Percentage of Entire Sample 

Enrolled in public, in-state institution Fall 2002 

41.3% 

Persistence to Fall 2003 

30.2% 

Graduation with Bachelor's within 5 years 

12.1% 
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Sample 


Table 3: Percentage of Free Reduced Lunch and Limited English Proficient students who Enroll 

l_ l/ l_“ i_ ; ■■ 

Persist, Graduate from a Public Instate Institution 

■ lm 


Outcome 

Percentage of 

Percentage of 


JVR Lunch 

LEP 

Enrolled in public, in -state institution Fall 2002 

33.0% 

41.6% 

Persistence to Fall 2003 

21.9% 

30.6% 

Graduation with Bachelor's within 5 years 

5.4% 

7.3% 


Table 4: Percentage ofS.iT Taking and AP Participating Students who Enroll, Persist? Graduate 


from a Public Instate Institution 

L" 


Outcome 

Percentage of 

Percentage of 


SAT Takers 

AP Takers 

Enrolled in public, in -state institution Eall 2002 

55.9% 

55.8% 

Persistence to Fall 2003 

44.8% 

47.8% 

Graduation with Bachelor's within 5 years 

21.4% 

28.8% 
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Results: Enrollment 

Enrollment =1 if a student enrolled in a 2 or 4 yr college in the fall semester immediately following graduation from high school (Fall 2002) 


Table 5: Empty Logistic Multilevel Model Predicting Enrollment 


Fixed Effects 

Coefficient (SE) 

Odds Ratio 

t(df) 

P 

Intercept (yoo) 

-0.61 (0.04) 

0.55 

-14.75 (3S2) 

0.00 


Random Effects 

Variance 

df 

Chi square 

m 

0.56 

382 

8487.87 (0.00) 


The estimated probability of enrollment for students in this 
sample is .35 (calculated as exp(-.61)/(l + exp(-.61) = 0.54/(l + 
0.54) = 0.35) 


The intraclass correlation coefficient for this model is . 1 5 
(calculated as ICC = xoo/( too+3.29) = .56/(.56+3.29) = .15) 

\ CoUegeBoard 
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Results: Enrollment 


• All student level variables were included in the model to determine 
those that are significant predictors of enrollment and their variation 
across schools 

Table 6: Le\ : el 1 Logistic Coefficients Model Predicting College Enrollment 


I nte rce pt w») 

Gender_F (vlO) 

Lunch (y20) 

HS_GPA (v30) 
lOth_Readingiyif0j 
SAT_Take (ySO) 

PCT_HNRS (vffl) 

Race_ Black (y70) 

Race_His (yflD) 

Race_Oth 

Random effects (var. components) 

I nt e rce pt froo) 


Coefficient 

Odds 



(SE> 

Ratio 

t(df) 

P 

-1.32 

0.27 

-21.42(378) 

0.00 

0.23 

1,25 

11.50 (378) 

0,00 

-0.33 

0.72 

-14.309 (378) 

0.00 

^ 0.61 

1.85 

16.192 (378) 

0.00 

0.001 

1 

3.572 (378) 

0.00 

0.91 

2.49 

30.03 (378) 

0.00 

1.01 

2.75 

8.15 (378) 

0.00 

0.3 

1.35 

7.5 (378) 

0.00 

0.16 

1.18 

5.22(378) 

0.00 

0.33 

1.39 

7.22(378) 

0.00 

Variance 

df 

Chi-Square 

a 

1.11 

278 

1674.85 

0.00 
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Results: Enrollment 


• Lastly, all school-level variables were included in the model (significant 
interactions shown below) 

Table 7: Contextual Logistic Model Predicting College Enrollment 


Model forthe intercepts 

Coefficients 

(SE) 

Odds 

Ratio 

m 

P 

Intercept (yOO) 

-1.14 (.05) 

0.32 

-21.71 (244) 

0.00 

PCTABS21 (\fll) 

-.03 (.01) 

0.97 

-3.20(244) 

0.002 

PCT_ACT (yM) 

,01 (.004) 

1.01 

2.75(244) 

0.01 

PCT_SAT(y06) 

-1.02 (.47) 

0.36 

-2.19(244) 

0.03 

PCT_PSAT (yOT) 

.65 (.29) 

1.92 

2.20(244) 

0.03 

PCT_G ift (v010) 

.05 (.01) 

1.05 

3.31(244) 

0.001 

Num_FTE(y015) 

Modelfor GenderC slope 

0.01 (.00) 

1.01 

3,95(244) 

0.00 

Intercept (ylO) 

.23 (.02) 

1.25 

9,05(244) 

0.00 

PCT_Lunch (yl2) 

Modelfor Lunch slope 

.58 (.23) 

1.78 

2.55 ( 244) 

0.01 

Intercept (yZO) 

-0.33 (.03) 

0.72 

-11,65(58,997) 

0.00 

TeachAvg(y29) 

-.02). 01) 

0.98 

-2.21(58,997) 

0.03 

Num_FTE (y215) 
ModelforHSGPSsIope 

-.002 (.001) 

0.99 

-2.89(58,997) 

0.00 

Intercept (v30) 

.64 (.04) 

1.89 

17,33 (244) 

0.00 

PCT_Lunch (y 32) 

-1.14 (.33) 

0.32 

-3.46 ( 244) 

0.00 

PCT_SAT ( V 36) 

-1.69 (.31) 

0.18 

-5,45(244) 

0.00 

Num_FTE (V-315J 

Modelfor 10th_Reading slope 

-.003 (.001) 

0.99 

-2.03 ( 244) 

0.04 

Intercept (y40) 

0,001 (.0004) 

1.00 

3,65 (58,997) 

0.00 

PCT_SAT (v46) 

Modelfor SAT_Take slope 

-.01 (.003) 

0.99 

-2.25(58,997) 

0.02 

Intercept (ySO) 

.87 (.03) 

2.39 

25,71 (244) 

0.00 

PCT_ACT(y54) 

-.01 (.002) 

0.99 

-2.79 ( 244) 

0.01 

pct_sat(vsb;. 

1.25 (.30) 

3.51 

4.16 ( 244) 

0.00 


ModelforPCTHonors slope 

Intercept (y60) 

.85 (.15) 

2.34 

5.81(244) 

0.00 

Mean_SAT(y65) 

-.003 (.001) 

1.0 

-2,25 ( 244) 

.03 

PCT_G ift (y 610) 

-.10 (.03) 

.91 

-2,85(244) 

.01 

PCT_ELL(y611j 

-.08 (.03) 

.92 

-2,55 ( 244) 

.01 

Nurm_FTE(y615) 

-.01 (.01) 

.99 

-2.23(244) 

.03 

Model for Race_BLA slope 

1 nte rcept (y70j 

.23 (.04) 

1.26 

6.16(58,997) 

0.00 

PCT_PSAT(y77j 

-.40 (.20) 

.81 

-2.02(58,997) 

.04 

PCT_ELL(y711j 

-,02(.01j 

.98 

-2.01(58,997) 

.04 

DISC_TOT(y712) 

-.001 (.00) 

1.0 

-2.64(58,997) 

.01 

Model forRaceHIS slope 

Intercept (y80j 

,11 (.05) 

1.11 

2.18(58,997) 

.03 

Model for Race_OTH slope 

Intercept (y90j 

.36 (.06) 

1.43 

6.06(58,997) 

0.00 

PCT_ELL(y911j 

,04 (.01) 

1.04 

2.98(58,997) 

0.00 

NUM_FTE(y915) 

-.01 (.002) 

.99 

-2.96(58,997) 

.004 

Random effects (var. components) 

Variance 

df 

Chi-Square 

a 

Intercept (TOO) 

47 

225 

1025.08 

O.OQ 


Still a considerable amount of variance that could be 
further explained with additional measures. 
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Results: Persistence 

Persistence =1, if a student with enroll = 1 had a record of enrollment in Fall 2002, Spring 2003, and Fall 2003 semesters. 


Table 8: Empty Logistic Multilm-el Mods 1 Predicting Persistence 


Fixed Effects 

Coefficient (SE) 

Odds Ratio 

.(df) 

P 

Intercept (yoo) 

0.92 (0.03) 

2.51 

32.4S (362) 

0.00 


Random Effects 

Variance 

df 

Chi square 

IQQ 

0.1S 

362 

1436.20 (0.00) 


• The probability of a student from a typical high school persisting through to 
the Fall 2003 academic term in a public in-state institution of higher 
education after enrolling in the Fall 2002 term is 71.5 percent (calculated as 
exp(.92)/(l +exp(.92) = 2.51/3.51 = .715) 

• The intraclass correlation coefficient for this model is .05 (calculated as ICC 
= t00/( t00+3.29) = .18/(. 18+3.29) = .05) 
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Results: Persistence 


• All student level variables were included in the model to 
determine those that are significant predictors of 
persistence and their variation across schools 

Table 9: Le\-el 1 Logistic Random Coefficients Model Predicting College Persistence 

Odds 



Coefficient 

Ra~io 

t(df) 

p 

Intercept (yOQ) 

1.31 

3.7 

26.02 (335) 

0.00 

Gender (ylQ) 

0.09 

1.1 

2.31 (335) 

0.02 

LEP (y 2.0 j 

0.25 

1.29 

3.61 (335) 

0.00 

Lunch (y30j 

^ -0,3 

0.74 

-5.97 (335) 

0.00 

HS_GPA(y40) 

1.32 

3.76 

23.0 (335) 

0.00 

10th_Reading(y50) 

-0.002 

1.00 

-3.15 (335) 

0.00 

SATM (y6Q) 

0.001 

1.00 

3.29 (335) 

0.00 

PCT_HNRS (y7D) 

1.03 

2.79 

6.14 (335) 

0.00 

AP (ySQj 

^ ^ 0.35 

1.42 

7.08 (335) 

0.00 

Race_Bla (y90) 

0.3 

1.34 

5.17 (335) 

0.00 

Race_Oth (y 100 j 

0.48 

1.62 

5.29 (335) 

0.00 

Random effects (var. components! 

Variance 

df 

Chi-Square 

u 

Intercept (too) 

0.24 

33 

45.29 

0.08 
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Results: Persistence 


• Lastly, all school-level variables were included in the model (significant 
interactions shown below) 

Table 10: Contextual Logistic Model Predicting College Persistence 


Coefficients 

f SE J Odds Ratio tfdfj p 


Model forthe intercepts 

Intercept (vOOJ 1.22 (. 

PCT_Gift(vDlQ) .04 C. 

Num_FTE (v31£> .01 (. 

Model for Gender_C slope 

Intercept (vlO) .11 (. 

ModelforLEP slope 

Intercept (v20) -.01 f. 

ModetforLunch slope 

Intercept (v-30) -.2 5(. 

PCTELL (y311) .04 f. 

StudTeach (v3l4) .05 (. 

ModelforHSGPAslope 

Intercept (v40) 1.40 (. 

ModelforlOth_Reading slope 

Intercept (vSO) -.00 j. 

Model for SAT_M slope 

Intercept (y&Qj .00 f. 

PCT_ACT(y64j -.00 j . 

Model for PCT_Hlonors slopes— ^ 

Intercept jy70] ^*^1.14(. 

PCT_ACT(y74j .04 (. 

ModelforAP slope 

Intercept jySOj .37 (. 

Num_FTE (y815j -.01 f. 

Model for Race BLA slope 

Intercept (y90j .40 (. 

Model for Race Other slope 

Intercept (ylOOj .58 (. 


06) 

3.38 

19.20 (226) 

0.00 

01) 

1.05 

3.09 (226) 

0.00 

00) 

1.01 

2.61 (226) 

0.01 

06) 

1.12 

1.87 (18,623) 

0.06 

17) 

0.99 

-.04(18,623) 

0.97 

07) 

0.78 

-3.47 (18.623) 

0.00 

01) 

1.04 

3.20 (18.623) 

0.00 

03) 

1.05 

1.98 (18,623) 

0.05 

09) 

4.05 

15.94 (18,623) 

0.00 

00) 

1.00 

-1.00 (18,623) 

0.32 

00) 

1.00 

1.30 (18,623) 

0.20 

00) 

1.00 

-3.02(18,623) 

0.00 

28) 

3.12 

4.00 (226) 

0.00 

02) 

1.04 

2.07 (226) 

0.04 

07) 

1.44 

4.99 (18,623) 

0.00 

00) 

0.99 

-2.48 (18,623) 

0.01 

10) 

1.5 

4.22(18,623) 

0.01 

15) 

1.21 

-.49(18,623) 

0.00 


Random effects (var. components! Variance 


df Chi-Square 


Intercept^ 


.09 215 


382.40 


Persistence model 
warrants further 
investigation! 
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Results: Graduation 

Graduate = 1, if a student with enroll = 1 and persist = 1 had obtained a Bachelor’s degree from a public in-state university within 
five years from high school graduation. 


Table 11: Empty Logistic Multilevel Model Predicting Graduation 


Fixed Effects 

Coefficient (SE) 

Odds Ratio 

* (df) p 

Intercept (you) 

-0.48 (0.04) 

0.62 

-13.0 (353) 0.00 

Random Effects 

Variance 

df 

Chi square 

too 

0.33 

353 

2021.47 (0.00) 


• The probability of a student coming from a typical high school that enrolls in a public 
in- state higher education institution in Fall 2002 and persisting through to Fall 2003 
academic term graduating with a Bachelor’s degree within 5 academic years is 38.3 
percent (calculated as exp(-.48)/(l + exp(-.48) = 0. 62/(1 + 0.62) = 0.383). 
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The intraclass correlation coefficient for this model is .09 
(calculated as ICC = x00/( xOO+3.29) = .33/(33+3.29) = .09) 
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Results: Graduation 


• All student level variables were included in the model to 
determine those that are significant predictors of 
persistence and their variation across schools 

Table 12: Logistic Random Coefficients Model Predicting College Graduation 



Coefficient 

Odds Ratio 

t(dfj 

P 

Intercept fyOO) 

-0.51 (.06) 

0.6 

-.8.58 (328) 

0.00 

Gender (ylO) 

0.36 (.04) 

1.44 

8.62(328) 

0.00 

Lunch (y 2.0 j 

-.32 (.04) 

0.73 

-6.21 (328) 

0.00 

HS_GPA(y30) 

^ 2.0 (.06) 

7.38 

32.12 (328) 

0.00 

10- 1 _Reading(y40j 

.00 (.00) 

1.00 

5.04 (328) 

0.00 

SATM (y5Q) ^ 

.00 (.00) 

1.00 

5.03 (328) 

0.00 

PCT_HNRS (y 60 j 

2. 37 (.17) 

10.65 

13.89 (328) 

0.00 

AP(y7Q) 

^.22 (.05) 

1.25 

4.52(328) 

0.00 

Race_Asi (y80) 

-.40 (.10) 

0.67 

-4.09 (328) 

0.00 

Race_Bla (y90) 

.20 (.07) 

1.22 

2.82(328) 

0.01 

Race_His (y 100 j 

.38 (.07) 

0.68 

-5.29 (328) 

0.00 

Race_Qth (y 110 j 

.21 (.08) 

1.23 

2.63 (328) 

0.01 

Random effects (var. componentsl 

Variance 

df 

Chi-Square 

£ 

Intercept (cCX>) 

0.63 

38 

73.32 

0.00 
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Results: Graduation 


• Lastly, all school-level variables were included in the model (significant interactions shown below) 


Table 13: Contextual Logistic Model Predicting College Graduation 


Model fortfie intercepts 

Coefficients (SE) 

Odds Ratio 

t(df) 

P 

Intercept (#3) 

-.67 (.07) 

0.51 

-9.43(222) 

0.00 

PCT_ Lunch m 

-1.32[.64) 

0.27 

-2.07(222) 

0.04 

Mean_ACT(v03) 

,16[.06j 

1.18 

2.63(222) 

0.01 

PCT_ACT (v04) 

.011.01) 

1.01 

2.07(222} 

0.04 

ModeiforGender_C slope 

Intercept (ylO) 

.471.06) 

1.60 

7.48(15,004} 

0.00 

ModelforLunch slope 

Intercept (v20) 

-.461,08) 

0.63 

-5.61(15,004) 

0.00 

PCTABS2I ( V 21) 

-0.021.01) 

0,98 

-2,03(15,004) 

0.04 

Mean_SAT(v25| 

0.0021.00) 

1.00 

2,01(15,004} 

0.04 

PCT_PSAT(v27) 

.761.36) 

2.15 

2.12(15,004} 

0.03 

StudTeach [y214) 

.081.03) 

1.08 

2.60(15,004} 

0.01 

ModeiforHSGPAslope ^ 

Intercept [y3Q) 

2.06 j. 10) 

7.86 

19.90 (15,004) 

0.00 

ModelforlQthReading slope 

Intercept (\40) 

.011.00) 

1.01 

4.23(15,004) 

0.00 

PCTSAT (y46) 

-.031.01) 

0.98 

-2.67(15,004) 

0.01 

ModeiforSAT_M slope 

Intercept (y50) 

.0011.00) 

1.00 

3.79(15,004) 

0.00 

PCT_Lunch[y52) 

-.011.00) 

0,99 

-2.02(15,004) 

0.04 

TeachAvg [y59) 

-.00041.00) 

1.00 

-2.33(15,004) 

0.02 

PCT_ELL( V 511) 

.00021.00) 

1.00 

2.02(15,004) 

0.04 


i # 


ModelforPCTHonors slope 

Intercept (y60j 

^ 2.04 (.29) 

7.70 

7,10(15,004) 

0.00 

PCTSAT (y66) 

5,06(2.04) 

158.11 

2,48(15,004) 

0.01 

TeachAvg [y69) 

.19 (.09) 

1.21 

2.09(15,004) 

0.04 

StudTeach (v6l4) 

-.26 (.10) 

0.77 

-2.71 (15,004) 

0.01 

ModelforAP slope 

Intercept (v70) 

^^*■.23 (.07) 

1.26 

3,34(15,004) 

0.00 

PCT_G ift ( V 710) 

-.03 (.01] 

0.97 

-2,14(15,004) 

0.03 

Model for Race ASI slope 

Intercept (yfiO) 

-.49 (.16) 

0.61 

-2,98(15,004) 

0.00 

PCTACT (y84) 

-.02 (.01) 

0.98 

-2,18(15,004) 

0.03 

TeachAvg (vB9) 

.12 (.05) 

1.13 

2,30(15,004) 

0.02 

Modelfor RaceBLA slope 

Intercept (y90) 

,38 (.11) 

1.47 

3,53(15,004) 

0.00 

PCTABS2I (y91) 

-.03 (.01) 

0.97 

-2.33(15,004) 

0.02 

ModelforRace_HIS slope 

Coefficients (SE) 

Odds Ratio 

t(df) 

P 

Intercept(ylOO) 

-.35 (.14) 

0.71 

-2.46(15,004) 

0.01 

PCTTeachtyOB) 

-.03 (.01) 

0.97 

-2.16(15,004) 

0.03 

TeachAvg (v09) 

,11 (.04) 

1.12 

3.15(15,004) 

0.00 

Model for Race_Other slope 

Intercept (yllO) 

.27 (.13) 

1.31 

2.14(15,004) 

0.03 

Random effects (van 
components! 

Variance 

df 

Chi-Square 

a 

Intercept*™) 

.09 

222 

435.28 

0.00 


Discussion 


• Student- and school-level characteristics are 
important predictors of educational outcomes! 

• Results consistent with the College Board’s 
notion of College Readiness 

• Multiple measures (academic & non-cognitive) should 
be taken into account when assessing whether 
students are ready for college. 

• Academic measure - HSGPA + SAT + Academic Rigor 

• Evidence that AP test-taking is linked with 
success in college. 
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Limitations 


• Data Source 

• Not all institutions provide data (or accurate data) to 
The National Student Clearinghouse 

• Definition of Persistence 

• Too stringent? 

• Estimation method 

• Laplace vs restricted PQL 
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Future Research 


• Replicate study using the College Board’s new 
College Readiness indicator (HSGPA, composite 
SAT Scores and the new academic rigor index) 


• Conduct 3 level HGLM’s to examine how 
characteristics of institutions of higher education 
play a role in students’ decision to enroll. 
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Questions and Comments 


• Researchers are encouraged to freely express 
their professional judgment. Therefore, points of 
view or opinions stated in College Board 
presentations do not necessarily represent official 
College Board position or policy. 

• Questions should be directed to 
kgodfrey@collegeboard.org & 
hmatoselefonte@collegeboard.org 
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